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Foreword 

The  initial  focus  of  this  research  was  on  motion  planning  problems  for  autonomous  agile  vehicles.  At  the  the 
project  onset,  careful  discussions  between  the  Dr  Hua  Wang,  responsible  Program  Office,  and  the  PI  led  to  a 
shift  in  emphasis  to  the  study  of  motion  coordination  problems  for  multi-vehicles  networks. 
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1  Scientific  Progress  and  Accomplishments: 

Motion  Planning  for  Autonomous  Vehicles 

This  section  documents  the  work  in  [1],  [2]  on  the  design  of  low  complexity  algorithms  for  local  motion  planning 
problems.  We  have  developed  a  methodology  based  on  series  expansions  and  constructive  controllability  for 
nonlinear  control  systems. 

To  exemplify  our  approach,  let  us  start  by  briefly  considering  linear  control  systems  in  the  usual  form  x  = 
Ax  +  Bu{t ),  x  G  Mn,iz  G  Mm.  We  state  two  established  sets  of  results.  First,  the  forced  evolution  from  x(0)  =  0 
is  x(t)  =  fQ  eA^~s^Bu(s)ds.  Second,  if  and  only  if  the  system  is  controllable,  the  controllability  Grammian  is 
positive  definite: 

w  =  f  eA{T-s)BB'eA'iT-s)ds  >  0. 

Jo 

Relying  on  these  two  facts,  one  can  show  that  an  (energy  optimal)  open-loop  control  to  reach  the  target  final 
state  Xgoai  is  given  by 

u(t)  =  B'e^V-^W-'x  goal. 

The  references  present  a  methodology  to  replicate  these  analysis  and  design  steps  for  nonlinear  control  systems: 

Step  1  -  evolution  via  series  expansions  We  consider  a  class  of  polynomial  nonlinearities  common  to  robotic 
systems  and  vehicles.  In  [1],  we  show  how  the  initial  value  problem 

x  =  Ax  +  (x,  x)  +  Bu  ,  x(0)  =  0, 

where  / ^  :  Mn  x  Mn  — ►  Rn  is  a  symmetric  tensor,  admits  the  solution  x(t)  =  1  xk(t )  with 

Xi(t)  =  [  ej4(t_T) Bu{r)dT  ,  and  xk(t)  =  V  [  eA(t_T)/[21  (xa(r),  xk-a{r))dT  . 

Jo  „=i  Jo 

This  result  and  the  more  general  treatment  in  2(a)  extends  available  works  on  Volterra  series. 

Step  2  -  discretization  methods  Next,  select  base  functions  G  {1, . . . ,  n}},  e.g.,  sinusoids  or  splines, 

and  write  u(t)  =  JT  (/>j(t)cj .  The  evolution  of  the  nonlinear  control  system  is  a  function  of  c  G  Mn,  that 
can  be  developed  in  a  Taylor  expansion 

+oo 

*(T)=$(c)  =  $1c+^$fc(c,...,c)>  (1) 

k= 2 

where  is  a  matrix  and  {&k}  are  vector- valued  tensors.  To  solve  a  point-to-point  motion  planning  problem 
we  now  need  to  solve  this  equation  for  x(T)  =  xgoai-  In  reference  [2],  we  illustrate  how  minimum  energy 
control  problems  can  also  be  discretized  and  transcribed  into  equations  similar  to  (1). 

Step  3  -  inversion  via  series  expansions  Given  equation  (1),  a  solution  cgoai  to  ^(cgoai)  =  £g0ai  exists  under 
linear  controllability  assumptions,  and  can  be  written  in  closed  form  as: 

+oo 

Cgoai  =  ’  where  °1  =  ^r^goal,  Cfe  =  ^  ^m(ch,.  .  .  ,  Cim) . 

k= 1  iiH - \-im=k 

In  reference  [2]  we  discuss  truncation  methods,  design  an  alternative  iterative  algorithm,  and  provide  closed 
form  bounds  for  both  algorithms. 

The  work  in  [1]  and  [2]  provides  a  viable  methodology  to  design  local  planning  algorithms.  Numerical 
simulations  on  a  1-dimensional  and  6-dimensional  vehicle  model  are  presented  in  [2].  These  two  papers  are 
directly  related  to  the  deliverables  outlined  in  the  proposal  narrative. 

This  grant  also  supported  our  research  into  motion  planning  algorithms  via  other  algorithmic  approaches. 
The  work  in  [3]  illustrates  how  local  planning  methods  can  be  integrated  into  global  planners.  The  work  in  [4]  is  a 
contribution  to  motion  planning  problems  with  moving  obstacles.  The  work  in  [5,  6]  illustrates  how  the  proposed 
approach  is  applicable  to  the  setting  of  mechanical  control  systems,  such  as  manipulators  and  multi-body  systems. 


2  Scientific  Progress  and  Accomplishments: 

Deployment  and  Coverage  Control  for  Multi- Vehicle  Networks 

The  objective  of  this  research  is  to  develop  a  complete  set  of  primitives  for  deployment  and  motion  coordination 
in  multi-vehicle  networks,  including  coverage,  formation  control,  flocking,  swarming,  and  rendezvous  problems. 

We  investigate  multi- vehicle  coordination  in  a  comprehensive  fashion,  developing  fundamental  modeling  tools 
(what  are  appropriate  motion,  communication  and  energy  consumption  models?),  metrics  for  performance  anal¬ 
ysis  (when  is  a  configuration  or  a  coordinated  move  optimal?),  and  algorithmic  design.  In  particular,  it  is  of 
central  importance  to  design  algorithms  that  will  gently  scale  with  the  number  of  vehicles  and  devices  present  in 
the  network. 

We  tackle  optimal  deployment  and  coverage  problems  in  their  numerous  variations.  This  class  of  problem  is 
very  broad  and  the  features  of  specific  formulations  vary  drastically  with  the  underlying  physical  assumptions. 
Critical  parameters  include: 

1.  the  environment  of  interest  can  be  two  or  three  dimensional,  known  or  unknown,  uniform  or  nonuniform 
(e.g.,  portions  of  the  environment  might  be  of  greater  interest),  stationary  or  non-stationary  (e.g.,  bound¬ 
aries  and  nonuniformity  may  depend  on  time); 

2.  the  deployment  objectives  can  vary  depending  on  the  ultimate  network  objective:  examples  include  search 
and  exploration,  target  detection,  localization  and  tracking,  wireless  communication  coverage,  environmen¬ 
tal  monitoring; 

3.  the  communication  and  sensing  characteristics  of  individual  vehicle  can  be  uniform  or  heterogeneous  (e.g., 
antennas  and  sensors  can  be  directional  or  omni-directional),  the  vehicle  mobility  and  dynamics  can  vary 
drastically. 

Our  work  in  this  area,  supported  by  this  grant,  is  documented  in  the  conference  submissions  [7,  8,  9,  10,  11] 
and  the  journal  manuscripts  [12,  13,  14].  We  describe  some  example  results  in  the  next  pages. 

State-of-the-art  in  deplyoment  and  motion  coordination  primitives 

This  research  relies  on  a  growing  research  effort  focused  on  motion  coordination  algorithms  for  multi-vehicle 
networks.  Key  problems  involve  flocking  [15,  16],  foraging  [17],  rendezvous  [18,  19],  coverage  [20],  cooperative 
search  [21],  and  formation  control  [22,  23].  It  is  important  to  note  that  heuristic  approaches  to  the  design  of 
basic  interaction  rules  have  been  investigated  within  the  literature  on  behavior-based  robotics;  see  [24,  25,  26,  27]. 
However,  only  recently  has  there  been  a  systematic  effort  to  design  truly  scalable  and  provably  optimal  algorithms; 
e.g.,  see  [15,  18].  Along  this  line  of  research,  no  comprehensive  results  are  currently  available  on  how  to  design 
motion  coordination  primitives,  ensure  their  correctness,  and  guarantee  their  optimality  with  respect  to  an 
aggregate  objective. 

Coverage  notion  and  related  optimization  problems  in  (static)  wireless  sensor  networks  are  discussed  for 
example  in  [28,  29].  Coverage  is  naturally  cast  as  a  spatial  resource  allocation  problem  and  studied  in  a  discipline 
called  location  optimization  [30,  31].  A  final  component  in  our  approach  is  our  intent  to  identify  and  exploit  the 
computational-geometric  and  graph-theoretical  structure  inherent  to  these  problems;  see  [32,  33,  34]. 

Technical  approach  to  deployment  and  motion  coordination 

In  what  follows  we  illustrate  the  results  we  have  obtained  in  some  aspects  of  this  broad  theme.  The  following 
performance  metrics  and  coordination  algorithms  are  meant  to  illustrate  the  proposed  approach  and  not  to 
restrict  our  research  objectives  to  any  specific  setting.  The  general  “bottom-up”  approach  is  to  design  basic 
behaviors,  formalize  the  resulting  network  model  through  nonlinear  and  hybrid  systems  theory,  and  prove  converge 
correctness  via  Lyapunov  and  invariant  theory. 

We  discuss  mainly  deployment  problems.  The  following  material  relies  on  and  is  an  extensions  of  our  recent 
journal  submissions  [12,  13,  14]  (and  corresponding  conference  submissions).  Here,  let  Q  be  a  region  in  M3 
and  let  ||  •  ||  be  the  Euclidean  distance.  Let  P  =  (pi, . . .  ,pn)  be  the  location  of  n  agents,  each  moving  in  the 
environment  Q. 

PI)  Area- Coverage  Deployment  [Problem  setup]  Let  </>  :  Q  — >  M+  play  the  role  of  a  distribution  density 
function;  i.e.,  </>  measures  how  many  users  of  the  communication  channel  are  present,  or  how  important  it  is  to 
cover  a  certain  region  in  the  environment  Q.  Because  of  noise  and  loss  of  resolution,  the  sensing  or  communication 
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performance  at  point  q  G  Q  taken  from  ith  agent  at  the  position  pi  degrades  with  the  distance  \\q— _p*!j  we  describe 
this  degradation  with  a  monotone  (decreasing)  function  /  :  R+  — >•  R+.  In  other  words,  /  (||g  —  Pi\\)  is  a  point- 
wise  quantitative  assessment  of  how  poor  the  sensing/communication  performance  is.  Since  typical  agents  have 
limited-range  footprint,  it  is  realistic  to  assume  that  f  (\\q  —  Pi\\)  is  constant  (equally  poor)  outside  the  sphere 
Br(pi)  centered  at  pi  of  radius  r.  As  specific  example,  we  let  f  (\\q  —  Pi\\)  equals  1  if  q  is  inside  the  sphere  Br(pi) 
and  0  otherwise.  This  performance  function  leads  to  the  following  interpretation:  the  agent  i  provides  equally 
good  sensing/communication  coverage  over  all  points  in  its  sphere  of  influence. 

[Performance  metric]  In  a  first  approximation,  let  us  assume  that  each  individual  agent  is  uniquely  responsible 
for  wireless  coverage  and  measurements  taken  over  a  region  to  be  determined.  Let  W  =  {Wi, . . .  ,lbn}  be  a 
collection  of  n  regions  with  disjoint  interiors  whose  union  is  Q;  we  call  W  a  partition  of  Q  and  W{  the  dominance 
region  of  agent  i.  Consider  the  coverage  performance  metric  7Y(P,  W)  =  Y^i=i  Jw  /(II#  —  Pi\\)d(j)(q).  The 
function  Ti  is  to  be  maximized  with  respect  to  the  agents  location  P  and  to  the  assignment  of  the  dominance 
regions  W.  One  can  easily  see  that,  at  fixed  locations  (pi, . . .  ,pn),  the  optimal  partition  is  the  Voronoi  partition 
V(P)  =  {Vi, . . . ,  Vn}  defined  by  V  =  {q  E  Q\  \\q  —  Pi\\  <  \\q  —  Pj  ||  ,  Vj  7^  i}.  Therefore,  an  equivalent  expression 
of  optimal  coverage  is  H(P,V(P))  =  E  [maxiGp)>ii)n}  f(\\q  —  Pi\\)].  Remarkably,  one  can  show  [14]  that 


l^(- p,V(P))=  [  f-f  {\\q-pi\\)d4>{q), 

°Pi  JViHBripi)  aPi 


and  deduce  the  following  critical  property:  the  gradient  of  Ti  is  decentralized  in  the  sense  that  it  can  be  computed 
with  information  localized  to  each  individual  sphere  of  influence  and  Voronoi  cell.  Closed-form  expressions  for 
this  partial  derivative  can  be  computed  under  various  assumptions  on  the  shape  of  /. 

[Algorithm  design]  Finally,  we  design  a  deplyoment  algorithm  under  the  assumption  that  each  agent  location 
obeys  a  first  order  dynamical  behavior  described  by  pi  =  Ui.  Set  iq  =  J^-(P,  V(P))  —  p*,  where  V(P)  = 
{Vi, . . . ,  Vn}  is  continuously  updated  in  a  decentralized  computation.  This  closed- loop  system  is  a  gradient  flow 
for  the  cost  function  Ti  so  that  performance  is  indeed  locally,  continuously  optimized.  The  coverage  optimization 
function  Ti  is  a  Lyapunov  function  and  the  group  of  mobile  agents  is  guaranteed  to  converge  to  a  local  maximum 
of  Ti.  Fig.  1  illustrates  the  performance  of  this  coordination  algorithm  when  Q  is  a  2D  convex  polygon. 
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Figure  1:  Area-coverage  deployment  for  16  agents;  the  region  of  interest  is  characterized  by  a  density  function  equal  to  the  sum 
of  Gaussians.  The  left  (resp.  right)  figure  contains  the  countur  plot  of  the  density  function,  the  initial  (resp.  final)  position  of  the 
agents,  the  agents’  sphere  of  influence  and  Voronoi  partitions.  The  central  figure  illustrates  the  joint  motion. 


P2)  Deployment  for  Maximum  Detection  Likelihood  Next,  we  consider  a  second  formulation  of  deploy¬ 
ment  with  a  different  network  objective.  We  consider  n  mobile  devices  equipped  with  acoustic  sensors  attempting 
to  detect,  identify,  and  localize  a  sound-source  (we  could  similarly  envision  antennas  detecting  RF  signals,  or 
chemical  sensors  localizing  a  source).  For  a  variety  of  criteria,  when  the  source  emits  a  known  signal  and  the 
noise  is  Gaussian,  we  know  that  (1)  the  optimal  detection  algorithm  involves  a  matched  filter,  (2)  detection 
performance  is  a  function  of  signal-to- noise-ratio,  and,  in  turn, (3)  signal-to- noise  ratio  is  inversely  proportional 
to  the  sensor-source  distance.  How  do  we  deploy  the  agents  and  optimize  their  location  to  maximize  the  detection 
probability? 

Recall  that,  the  circumcircle  of  a  given  polygon  is  the  smallest  circle  enclosing  the  polygon;  circumradius 
and  circumcenter  and  radius  and  center  of  the  circumcircle,  respectively.  Given  this  notion,  we  introduce  the 
following  simple  algorithm.  If  each  agent  moves  toward  the  circumcenter  of  its  Voronoi  cell,  then,  as  a  function 
of  time,  the  detection  likelihood  is  inversely  proportional  to  the  circumradius  of  each  agent’s  Voronoi  cell,  and 
the  detection  likelihood  is  monotonically  increasing,  see  Fig.  2. 
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Figure  2:  Deployment  of  16  agents  for  maximum  likelihood  detection.  The  left  (resp.  right)  figure  contains  the  initial 
(resp.  final)  position  of  the  agents,  and  the  Voronoi  partitions  and  circumcircles  of  each  agent. 


The  fundamental  reason  this  behavior  is  correct  is  the  existence  of  an  appropriate  Lyapunov  function,  with 
respect  to  which  the  given  behavior  is  dissipative.  It  turns  out  that,  as  a  function  of  the  agents’  position,  an 
appropriate  cost  function  is  the  maximum  of  the  radiuses  of  disks  centered  at  each  agent’s  position  and  covering 
each  agent  Voronoi  cell. 

P3)  Visibility-based  Deployment  Here  we  consider  a  third  and  final  scenario,  namely  that  of  deployment 
of  agents  in  planar  non-convex  regions.  Coverage  performance  is  quantified  in  terms  of  visibility:  one  reason¬ 
able  coverage  objective  is  to  deploy  the  ad-hoc  network  in  such  a  way  as  to  obtain  complete  visibility  of  the 
environment.  This  formulation  of  the  coverage  problem  is  a  distributed  feedback  version  of  the  so-called  “art 
gallery  problem.”  This  problem  is  a  classic  topic  in  computational  geometry,  e.g.,  see  [35,  36].  Let  us  provide  a 
heuristic  algorithm  that  has  demostrated  excellent  performance  in  simulations  and  that  is  conjectured  to  have 
correctness  guarantees  for  sufficiently  large  numbers  of  agents.  For  alii  G  {1, . . . ,  n},  the  ith  agent  computes  its 
dominance  polygon  Wi  C  Q  as  the  set  of  points  in  the  environment  for  which  pi  is  either  the  only  visible  agent 
or  the  closest  visible  agent.  Each  agent  then  moves  toward  the  furthest  vertex  in  its  dominance  polygon.  The 
outcome  is  illustrated  in  Fig.  3. 


Figure  3:  Visibility-based  deployment  for  9  agents  in  a  somewhat  typical  floor-plan.  Each  frame  depletes  the  agents  and  their 
respective  dominance  region. 


There  are  a  number  of  open  issues  related  to  this  class  of  visibility-based  deployment  problems.  A  first 
research  objective  is  to  provide  a  correctness  proof  for  this  algorithm  under  the  smallest  possible  assumption 
on  the  number  of  required  agents.  The  extension  to  the  3  dimensional  case  would  also  be  very  relevant  in 
applications.  A  final  important  set  of  problems  is  related  to  the  information  flow  required  for  the  implementation 
of  this  algorithm.  Note  that  each  agent  needs  to  know  the  location  of  every  other  agent  it  is  sharing  some 
viewpoints  with.  It  is  our  future  objective  to  weaken  this  requirement  to  the  simple  knowledge  of  the  location  of 
each  other  visible  agent. 
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3  Scientific  Progress  and  Accomplishments: 

Experimental  advances  —  the  Multi-Rover  Network  Laboratory 

We  have  developed  a  multi- vehicle  testbed  based  on  all-terrain  rovers  for  indoor  and  outdoor  environments.  Each 
rover  is  based  on  an  model  RC  vehicle,  a  computing  and  communication  suite,  and  a  navigation  and  sensing 
suite:  all  components  are  commercial  off-the-shelf,  and  most  software  is  open  source. 
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Figure  4:  An  initial  implementation  of  a  mobile  autonomous  robots  based  on  a  model  RC  truck,  a  PC  104  single 
board  computer,  and  an  802.11  wireless  nic.  All  components  are  cots. 

(1)  The  vehicle  chassis,  motors,  wheels,  and  batteries  are  those  found  in  the  model  RC  truck  “Emaxx” 
manufactured  by  the  company  Traxxas,  Inc.  For  our  modified  vehicle,  maximum  speed  is  about  20mph,  expected 
battery  duration  is  20minutes,  initial  payload  is  51b,  the  model  is  20in  long  and  15in  wide,  the  height  off  the 
ground  is  lOin.  The  motors  are  high-voltage  high  performance,  the  transmission  is  all-wheel-drive  and  two  speed. 
An  inexpensive  micro-controller  from  Pontech  Inc.  provides  a  serial  ASCII-based  interface  to  the  motors  and 
speed  controller.  The  model  is  endowed  with  a  100  count  per  revolution  optical  encoder  for  odometry. 

(2)  On-board  computation  is  performed  by  a  single-board  embedded  computer  with  PC104-compatible  ex¬ 
tension  bus,  266MHz  Pentium  processor,  disk-on-chip  as  hard  drive,  and  numerous  input-output  interfaces.  The 
board  is  in  EBX  form  factor  which  is  8in  x  5.75in.  The  board  model  is  VNS-786  manufactured  by  JUMPTech 
Adastra  Systems  Inc.  Each  processor  runs  a  Mini  Real-Time  Linux  operating  system.  The  implementation  is 
based  on  the  Linux  Router  project  and  relies  on  a  tarred  compressed  file-system. 

(3)  An  extension  PC104  board  provides  the  single-board  with  a  PC  Card  interface.  A  802.11b  wireless 
network-interface-card  in  PC  Card  format  provides  local  communication.  The  navigation  suite  currently  includes 
only  a  differential-ready  GPS  receiver,  the  Gar  min  GPS  16.  The  GPS  information  is  transmitted  to  the  embedded 
PC  through  a  serial  line  using  the  standard  ASCII  protocol  NMEA-0183.  We  plan  in  the  future  to  purchase 
tri- axial  accelerometers,  inclinometers,  and  a  compasses.  Additionally,  we  hope  to  purchase  a  suite  of  sensors, 
e.g.,  sonars  and  cameras. 

(4)  The  experimental  platform  is  being  developed  in  the  “Multi-Rover  Network  Laboratory”  in  room  B16 
in  the  Coordinated  Science  Laboratory  (CSL)  at  UIUC.  The  room  is  about  500ft2,  endowed  with  currently  3 
workstations  and  2  development  platforms. 

(5)  The  software  infrastructure  is  a  multi-threaded  priority-based  architecture.  Threads  are  being  developed 
to  deal  with  sensors  and  actuators  interfaces,  high-level  communication  protocols,  data  fusion  and  estimation 
algorithms,  inner-loop  and  planning  control. 
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